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Abstract 

In the Standard Model with two Higgs doublets (type II), which has a consistent 
trend to a flavor gauge theory and its related flavor democracy in the quark and the 
leptonic sectors (unlike the minimal Standard Model) when the energy of the probes 
increases, we impose the mixed quark-lepton flavor democracy at high "transition" energy 
and assume the usual see-saw mechanism, and consequently find out that the existence 
of the fourth generation of fermions in this framework is practically ruled out. 
PACS number(s): 12.15.Ff, 12.15. Cc, 11.30.Hv 



The number of the light neutrino species with masses below Mz/2 has been measured 
very accurately at LEP [p]], and it is only three. However, we believe this measurement 
does not completely exclude the existence of the fourth generation, if the neutrino of 
this generation is, for as yet unknown reasons, very heavy (presumably heavier than 
Mz/2). In this paper we would like to examine the question of the non-exsistence of the 
fourth generation in the framework of flavor gauge theory and its related flavor democracy 
(FD) §. 

The notion of flavor democracy for quarks (q-q FD) at low ("physical") energies 
is well-known by now M. It means that a fermion flavor basis[| exists in which the 
Yukawa couplings to ur quarks (and separately to cLr quarks) are all equal and that 
there is no Cabibbo-Kobayashi-Maskawa (CKM) mixing. The FD in the leptonic sector 
(charged leptons and Dirac neutrinos) is defined analogously. In reality, fermions at low 
energies manifest the flavor democratic structure only to a first approximation. However, 
at increasing energy of probes, the minimal Standard Model (MSM) and the closely related 
"type I" Standard Model with two Higgs doublets (2HDSM(I)) have a clear trend away 
from FD, while the usual "type II" Standard Model with two Higgs doublets (2HDSM(II)) 
has a consistent trend to FD in all quark and leptonic sectors (q-q FD and £-£ FD) ||. 

In the mass basis, neglecting the light first generation, the trend to FD in the quark 
sectors (q-q FD) means: 

— - , — - , (V c km)cb — ► as E — > A pole , (1) 
m b m t 

and analogously in the leptonic sectors (£-£ FD). Here, A po ; e is the Landau pole where the 
Yukawa couplings blow up. 

The motivation behind these notions is the following. One could assume that the 
Standard Model at some high "transition" energy E t rans. ~ A-poie is replaced by a new 
strongly interacting physics with almost flavor-blind forces, where the tiny deviation from 
the "flavor-blindness" is provided by some as yet unknown mechanism (e.g. a mechanism 
having its origin in string theory, etc.) and/or possible radiative corrections near E tra ns.- 
In such a framework, the 2HDSM(II) would be definitely favored as the low energy theory, 
1 This is a basis in which ^ = (Vv V'd)) transforms as an iso-doublet under the SU(2)l. 
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in comparison to the MSM or to its closely related 2HDSM(I) [0. Furthermore, the Higgs 
sector could possibly be explained through the mechanism of condensation of the neutral 
Higgses Q near E tra ns., allowing realistically low values for mF^ y {ra\ v < 200 GeV for 
Etrans. ~ ^poie <C Apianck, for a large range of values of the ratio of the vacuum expectation 
values: v u /vd ~ 1.75 0,0), unlike the condensation mechanism leading to the MSM ||. 
The entire results concerning the trend to FD can, however, be regarded independently 
of the motivation outlined above. 

If we want to have the number of degrees of freedom at E trans . (~ A po i e ) in the 
Yukawa sector of the 2HDSM(II) additionally reduced, we can impose the mixed quark- 
lepton flavor democracy (q-£ FD) 

m t ~ m^ T , m b ~m T at E ~ k vole , (2) 

which would leave us at high "transition" energy with basically only two Yukawa couplings 
(g up and gdown] \g up \ 3> \9down\), and would provide^us with the Dirac neutrino mass m® T 
(at E = 1 GeV) and A po ; e , for a chosen ra\ v and tan (3 = v u / v^. The see-saw mechanism 
would subsequently furnish us with an estimate (upper bound (u.b.)) for the resulting 
physical neutrino mass [0 

M Majorana *> E trans . ~ A pole =► my ~ (m£)a * = (m^)"- 6 - . (3) 

^Majorana ^pole 

Here we would like to raise the question whether in this flavor democracy-favored 
2HDSM(II) model the imposed q-£ FD would be compatible with the existence of the 
fourth generation of heavy fermions (t', b'), (ufi, r')\ 

m t > ~ , ra v ~ ra T > at E ~ A poie . (4) 

Through the application of the 1-loop renormalization group equations (RGEs) for the 



Yukawa couplings in the MS scheme (see Appendix), this condition (4), together with 

the known masses of the third generation fermions (we neglect the influence of the light 

fermions of the first and the second generations - a very good approximation), yield a 

2 Since m^ hy <C m^ hy , the condition nit, ~ m T at E ~ A po ; e is automatically satisfied ("pull-up" 
effect) through the condition m t ~ at E ~ A po ; e . 
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one-to-one correspondence 

m p t hy , tan/3(= — ) , mf y , m P y V < — > k voie , mft v , , (5) 

where f is the Dirac mass of the heavy neutrino at E = 1 GeV. The meaning of the 
relation (|5|) is the following. We choose as an input any specific values of ra phy , tan/3, 
mf/ iy and Tn^ y , and then we look for ("adjust") mF^ y and (E = 1 GeV) such that 
the q-1 FD condition (Q) is satisfied, thus obtaining the l.h.s. of (|5]) as output. The 
see-saw mechanism would then additionally provide us, similarly as in the case of three 
generations (cf. eq. (|[)), with an estimate (upper bound) for the physical neutrino mass 
on the r.h.s. of eq. (|5]) 

(m° ) 2 . (m? ) 2 fc , 

(~ m ) ~ V 1 ^ = ■ ( 6 ) 

M ajorana /julc. 

These calculations, leading with the q-£ FD condition (f|) from the l.h.s. to the 
r.h.s. of (|5|) (and to (^|)), were here performed with the 1-loop RGEs for the Yukawa 
couplings for the case of four generations (cf. Appendix) in the 2HDSM(II). We considered 
the first and second generations of fermions as essentially massless and ignored them, 
i.e. their mixing effects to the heavier fermions, in the RGEs. Furthermore, the threshold 
for the evolution of the RGEs was taken to be E t hresh. = ntf v , i.e. the RGEs for the 
third and the fourth generation were evolved only for energies E > E t hresh. = rrlF t hy . 
For E < Ethresh.^ the physics was considered to be described by the effective theory 
SU(3) C x U(l) em (without Higgs, W, Z, fourth generation and the top) [[(j, within the 
corresponding evolution interval [1 GeV, mf hy ] . We took in the RGEs the 2-loop solution 
for the SU(3) C gauge coupling 013(E), although it turned out that the results do not 
depend appreciably on it0. For the light third generation masses we tookQ m% hy ~ 4.3 
GeV, m T (E = 1 GeV) ~ 1.78 GeV. To determine the physical masses of heavy quarks, 

3 We chose: a 3 (M z ) = 0.118, corresponding to a 3 (E = 34 GeV) = 0.1387. The conclusions of this 
paper do not change if we take the experimentally suggested upper bound a 3 (E = 34 GeV) = 0.16 (see 
later). 

4 For simplicity, we chose the third generation Dirac neutrino mass (E = 1 GeV) = 0. It turned 
out that the results are virtually independent of the choice of (E = 1 GeV) . 
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we used the (Q CD-corrected) relation 

m phy 

3 7T 

When calculating the correspondence (j5|) with the RGEs in this way (taking into 
account the q-£ FD condition (|])), we further impose four physical constraints: 

m?^ y , m| , y > m\ v , (8) 
imP ) 2 

40GeV ~ mfy - , (9) 

-<*-pole 

Yukawa couplings at electroweak scale are within perturbative range , (10) 

( A p) heavy f ermions (h.f) < 0.0076 . (11) 

The first two constraints are based on experimental data. The third constraint was 
imposed to ensure that the Standard Model considered here (2HDSM(II)) is not manifestly 
non-perturbativef]. Specifically, we chose for fllOD a rather generous constraint: 

m Phy ? m Phy < 5 Apoi£ (12) 



The 1-loop expression for the contributions to Ap from heavy fermions (in MS scheme) 



is 



2 2 2 2mSmu 



mil- 



(A P ) h . f . = ^f{3K qcd [m 2 t + ml + m 2 , - ^ * ^ In -§-j 

2mi,ml , m 2 , 
+ [m^ +ml,- 2 % In } , (13) 
(mp — m 2 v J , 

where m t , m t /, to^, ttv, % , are the physical masses, and K qcd is the QCD correction 
parameter || 

K ^.^±A az . (14) 

y7T 

The fourth constraint (|TTJ) was obtained from an essentially model-independent analysis 
of the LEP data [plj . Furthermore, the analysis of the experimental evidence from B — B 



5 At E ~ (0.7 — 0.75)Ap O ; e , the 2-loop contribution to the r.h.s. of the RGEs (cf. Appendix) for the 
Yukawa couplings acquires approximately the same magnitude as the 1-loop contribution - this estimate 
is based on the structure of the 2-loop RGEs for the MSM. 
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and D — D mixing, Attik, ck and missing Et measurements at pp colliders suggests 



bounds on tan/3 [] I 



0.5 ~ tan/3(= — ) ~ 10 . (15) 

Vd 

It is interesting that in the case of three generations we had obtained tan/3 restricted 
between 0.53 and 2.1, once we imposed the q-1 FD at A po i e , the see-saw condition (]3p and 
took the experimentally prejudiced values (rnf, hy ) u ' b ' < 31 MeV and mf y = (175 ± 20) 
GeV 

The mass of the top quark has recently been measured by the CDF group at Fermi- 
lab [0: mt v ~ (174 ± 17) GeV. Therefore, we first took in our calculations wF^ v = 160 
GeV, and varied tan f3. When imposing the first three constraints (@)-(E[3) on the obtained 
results, we derived the allowed regions in the vs. wF t , y plane, as depicted in Figs. 1, 
2 and 3 for the cases tan/3 = 0.33, 1 and 3.5, respectively. Some remarks are in order 
here. The lower (dotted) boundaries in the figures originate from the heavy neutrino 
constraint (|9]), the upper (full line) boundaries from the "perturbative" constraint fllCf). 
When further varying tan /3, we can obtain the possible region: 

0.24 < tan/? < 5.2 , (for mf y = 160 GeV) 

where the perturbative constraint ( |i~2"|) does not allow us to push tan (3 beyond the above 
interval, since it then rules out the entire plane wF v hy vs. mF^ v (for m^, mF v hy > mt hy = 
160 GeV). Hence, the entire tan /3-interval as permitted by the constraints (|8|)- (|ToD is only 
within [0.24, 5.2]. 

One surprising feature of Figs. 1, 2, 3 is that the "perturbative" constraint (|10D in 
both cases of tan/3 = 0.33 (Fig. 1) and 3.5 (Fig. 3) turns out to be more restrictive 
than in the "middle" case of tan/3 = 1 (Fig. 1). This is due to the fact that the Yukawa 
coupling g t t (, gy) at low energies (E ~ rrit hy ) is quite largef] in the case tan/3 = 0.33 
(, 3.5, respectively), and consequently it increases with energy rather quickly and A po i e 
is relatively small (A po i e ~ 10 4 GeV). In the case of tan/3 = 1, on the other hand, both 
g t t and gy are relatively small at low energies and consequently increase relatively slowly 
with energy, so that the "perturbative" constraint ( |T0"D is not as restrictive. 

6 9v G 9b') a t energies near A po ; e is the dominant quark Yukawa coupling in the cases of tan/3 < 1.2 
(, > 1.3, respectively), for mP^ i=s mPy V 
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The most surprising thing is that, when we impose in addition the "p-constraint" 
(PI) upon the regions in Figs. 1, 2, 3, these regions become ruled out entirely. Namely, 
in the depicted regions the calculations yieldfl: (Ap)^} n = 0.0086, 0.0155, and 0.0084, for 
tan/? = 0.33, 1 and 3.5, respectively, all exceeding the maximum allowed value 0.0076. 
This turns out to be true for the entire interval [0.24, 5.2] for tan/5: (Ap)^.j > 0.0081. 
The largest contribution to the values of (Ap)™y™ comes from mf y (0.0072), the rest 
predominantly from heavy leptons. In the cases tan/3 > 3.5, the minima for (Ap)^./. 
are reached at the "perturbative" bound (where y ~ 0.5A po / e ). All in all, the Ap- 
constraint ( |TTj ) cannot be satisfied in the regions allowed by the other three constraints. 
Consequently, in the discussed case of m p t hy = 160 GeV, the q-£ FD condition (@) in the 
flavor democracy-favored 2HDSM(II) model, together with the usual see-saw mechanism, 
effectively rules out the existence of the fourth generation. 

When choosing higher mf y (> 160 GeV), (Ap)™^ 1 becomes even bigger and the 
"perturbatively allowed" interval for tan/3 becomes narrower. Hence, we can argue 
that for mf y > 160 GeV the q-£ FD requirement at E ~ E tra ns. — A po / e in the fla- 
vor democracy-favored 2HDSM(II) is not compatible with the existence of the fourth 
generation, i.e. this framework would practically rule out the fourth generation. We also 
performed calculations at the experimental lower bound for mf y (for mf y = 155 GeV). 
The "perturbatively allowed" interval for tan/3 is now slightly larger: [0.23, 5.37]. How- 
ever, the (Ap)™j n , in the regions allowed by the first three conditions, is in this case still 
above 0.0076, just reaching this value at tan/3 = 0.23, 5.37, as seen from Fig. 4. 

If we used instead of the rather conservative "perturbative" constraint (|i~2|) a more 
restrictive one (i.e. by replacing there 0.5A po ; e by a smaller value), we would exclude the 
existence of the 4th generation in the described framework even for the cases of m phy 
lighter than 155 GeV. Finally, we also investigated the effect of the CKM mixing by 
introducing V^j, ~ V v lT ~ 0.2 (at low energy), instead of no 3-4 generation mixing, and 
we found that the results changed only for a fraction of one percent. Therefore, the CKM 
mixing does not influence the results of this paper. 

7 when taking for the QCD parameter az{E = 34 GeV) the experimentally suggested upper bound 
0.16, the values of (Ap)™^™ increase slightly, but less than one percent. 
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We conclude that for all m p t y > 155 GeV, the existence of the fourth generation 
within the described scenario (q-1 FD at A po ; e , and see-saw mechanism) in the flavor 
democracy-favored 2HDSM(II) model is practically ruled out. We also note that if we 
abandon the assumption of the see-saw mechanism, we cannot rule out the existence of 
the fourth generation within the discussed flavor democracy framework. Namely, the low 
energy masses of r' and of the Dirac u T i are always above 100 GeV and rather close to 
each other, and we can choose such m^ hy ~ vrtiy V that the contributions of the fourth 
generation fermions to (Ap)h.f. are practically zero, thus resulting in having no effects of 
the Ap-constraint. 
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Appendix: "Type II Standard Model with two Higgs 
doublets and its RGEs" 



In the 2HDSM(II), only one Higgs doublet (H^) couples to the "up- type" right- 
handed fermions (f U R) and is hence responsible for their masses, and analogously the 
other Higgs doublet (H^) couples solely to the fdR 



C Yukawa = £ {[{qfH^Mf + h-c] + [($HW)<&D«> + h.c.]} 

- E {[{WmiM? + h.c] + [(WhM)i$d$ + h.c.]} , (i) 

where U^ q \ D^ q \ are 4x4 Yukawa matrices in flavor basis (in the case of four 

generations), and we use the notation 

hM = • ^ = ^ ■ ^ = 7f ("J (<• = «• <<> ■ 

«»-($• (3 (:) ■ (!) •««- • 



(2) 



The corresponding 1-loop renormalization group equations (RGEs) for the "squared" 
Yukawa matrices (= U^U^), QW (= £>(«)£>(«)t), i>) (= U^U^) and (= 
D^DWt), in MS scheme are 



at 


= 3Q (u)2 


- ^(g (u) g (d) + g (d) g (u) ) + 2qM(s£) 

Z 


-4?>) 


32vr 2 4gW 
dt 


= 3QW 2 


_ ^(g(«)gw + gWgH) + 2gW(~!f ) 


- 


dt 


= 3L^ 2 


_ ^(L(«)L^ + L^L^) + 2L^(Sf - 


4f } ), 


32tt 2 ^L^ 


= 3L^ 2 


_ i (L («) L (d) + L^L^) + 2L^(S? - 
2 
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where 



t = In 



(2E 2 



\ 9 1' 

V v J 

4«) = 4) = Tr(3g (M) + L (u) ) , 
S? ) = S? ) =rr(3QW + LM), 



7T 



17 



-«! + 9a 2 + 32a 3 



A® = 7r[3a! + 9a 2 ] , Af = 7r[15c*i + 9a 2 ] . 



(4) 



Here, E 1 is the energy of probes, ot\, a 2 and a 3 are the usual Standard Model gauge 
couplings corresponding to U(l)y, SU(2) L and SU(3) C , respectively, with N g = 4 in the 
case of 4 generations. 
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Figure Captions: 

FIG. 1. The region in the my y vs. wP t , v plane, as allowed by the three constraints (|8|)- 
(|j~0|). The lower (dotted) boundary originates from the heavy neutrino constraint (|9[), the 
other boundary (full line) from the "perturbative" constraint (|H]) (i.e. (|T2|)). The figure 
is for the 2HDSM(II), with q-1 FD at A pole , mf v = 160 GeV, and tan/3(= v u /v d )=0.33. 

FIG. 2. As Fig. 1, but for tan/3 =1. 

FIG. 3. As Fig. 1, but for tan (3 =3.5 



)min \ 
h.f.) 



FIG. 4. The Ap-contribution from heavy fermions, i.e. its minimal value ((Ap)} 
in the regions of the m 1 y V vs. rri? t , v plane that are allowed by the three constraints (§)- 
(|j~0|), as function of tan/3(= Vu/vj). The full line is for m£ fe2/ = 160 GeV, the dotted for 
155 GeV. Both lines are above the maximal allowed value of 0.0076 (cf. (JTT|) ) . 
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The figure is for the 2HDSM(II) with four generations, see-saw, and q-1 FD at A 



pole- 
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